Proper scoring rules for general decision models
نویسنده
چکیده
On the domain of Choquet expected utility preferences with risk neutral lottery evaluation and totally monotone capacities, we demonstrate that proper scoring rules do not exist. This implies the non-existence of proper scoring rules for any larger class of preferences (CEU with convex capacities, multiple priors). We also show that if a decision maker whose behavior conforms to the multiple priors model is faced with a scoring rule for a subjective expected utility decision maker, she will always announce a probability belonging to her set of priors; moreover, for any prior in the set, there exists such a scoring rule inducing the agent to announce that prior. Keywords: scoring rule, subjective expected utility, implementation, multiple priors, Choquet expected utility, probability elicitation. JEL classi cation: D81, C49 Assistant Professor of Economics, Division of the Humanities and Social Sciences, Mail Code 228-77, California Institute of Technology, Pasadena, CA 91125. Email: [email protected]. Phone: (626) 395-3559. I would like to thank Federico Echenique, PJ Healy, and John Ledyard for comments and suggestions.
منابع مشابه
Division of the Humanities and Social Sciences California Institute of Technology Pasadena, California 91125 Proper Scoring Rules for General Decision Models
On the domain of Choquet expected utility preferences with risk neutral lottery evaluation and totally monotone capacities, we demonstrate that proper scoring rules do not exist. This implies the non-existence of proper scoring rules for any larger class of preferences (CEU with convex capacities, multiple priors). We also show that if an agent whose behavior conforms to the multiple priors mod...
متن کاملChoosing a Strictly Proper Scoring Rule
S proper scoring rules, including the Brier score and the logarithmic score, are standard metrics by which probability forecasters are assessed and compared. Researchers often find that one’s choice of strictly proper scoring rule has minimal impact on one’s conclusions, but this conclusion is typically drawn from a small set of popular rules. In the context of forecasting world events, we use ...
متن کاملLoss Functions for Binary Class Probability Estimation and Classification: Structure and Applications
What are the natural loss functions or fitting criteria for binary class probability estimation? This question has a simple answer: so-called “proper scoring rules”, that is, functions that score probability estimates in view of data in a Fisher-consistent manner. Proper scoring rules comprise most loss functions currently in use: log-loss, squared error loss, boosting loss, and as limiting cas...
متن کاملProper Scoring Rules, Dominated Forecasts, and Coherence
De Finetti introduced the concept of coherent previsions and conditional previsions through a gambling argument and through a parallel argument based on a quadratic scoring rule. He shows that the two arguments lead to the same concept of coherence. When dealing with events only, there is a rich class of scoring rules which might be used in place of the quadratic scoring rule. We give condition...
متن کاملTailored proper scoring rules elicit decision weights
Proper scoring rules are scoring methods that incentivize honest reporting of subjective probabilities, where an agent strictly maximizes his expected score by reporting his true belief. The implicit assumption behind proper scoring rules is that agents are risk neutral. Such an assumption is often unrealistic when agents are human beings. Modern theories of choice under uncertainty based on ra...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Games and Economic Behavior
دوره 63 شماره
صفحات -
تاریخ انتشار 2008